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MODIFYING VIDEO BY INSERTING SHADOW INTRA PICTURES 

5 BACKGROUND OF THE INVENTION 
1. Technical Field 

The inventive arrangements relate generally to video recording systems 
and more particularly to video recording systems ttiat record digitally 
10 encoded video sequences onto disc media such as recordable digital video 
9 discs, hard drives and magneto optical discs. 
B 2. Description of Related Art 

MPEG video generally uses three types of picture coding methods: 
* Intra (I) pictures, predictive (P) pictures and bidirectional predictive (B) 
tjs pictures. I pictures are encoded or decoded independently of any other 

picture. This creates a reference picture from which P and B pictures, or non-1 
pictures, can be constructed. 

A number of MPEG video signals, however, are encoded without I 
pictures. In particular, many U.S. cable systems broadcast MPEG signals that 
20 do not contain I pictures. At first glance, such a video signal appears 

impossible to decode since there are no I pictures from which to construct 
the P and B pictures. 

Nevertheless, a video signal without any I pictures can be decoded by 
most MPEG decoders because a separate portion of each P picture in the 
25 signal is typically composed of i macroblocks. That is, successive P pictures 
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containing I macroblocks can be used to eventually properly decode a P 
picture, whicin can then be used to decode the remaining pictures in the 
video signal. As an exannple, in a block of five P pictures, twenty percent of 
each P picture can contain I macroblocks. For example, the top tv\/enty 

5 percent of the first P picture can be composed of I macroblocks and the 
lower eighty percent can be composed of non-1 macroblocks. Referring to 
the second P picture in the video signal, the portion representing the twenty 
percent of the picture immediately below the top twenty percent can 
comprise I macroblocks while the lower sixty percent and the top twenty 

10 percent can be composed of non-1 macroblocks. Thus, a different portion of 
each successive P picture contain I macroblocks. Hence, the bottom twenty 
percent of the last P picture can contain I macroblocks. 

These I macroblocks, along with the non-1 macroblocks contained in 
the P pictures, can be used to assemble each successive P picture. 

15 Specifically, as each P picture is decoded, the I and non-1 macroblocks can 
be stored in memory. As such, the decoder can generally properly decode 
the fifth P picture, from which the remaining P and B pictures can be 
decoded. 
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During normal playback of a video signal having no I pictures, tiiere is 
a brief period in whicin the picture quality suffers at the initiation of the 
playback. This is because the pictures at the beginning of the playback must 
be constructed from the P pictures that are not yet properly decoded. As an 
5 example, the first P picture in the playback signal normally contains the first 
portion of I macroblocks. Thus, the P and B pictures that are constructed 
from the first P picture cannot be properly decoded, as the first P picture 
O contains only roughly tv/enty percent of the information needed to produce 
S these pictures. As the playback continues, however, the picture quality 
;M=io improves since more of the P pictures are decoded thereby providing a 
=F greater number of correctly decoded I and non-1 macroblocks until a 
~i properly decoded P picture is acquired. This initial reduction in picture quality 
fu is acceptable since it is brief, as a properly decoded picture is usually 
IM> constructed within the first one-half second of normal playback of the video. 
15 Significantly, however, the delay in building a properly decoded P 

picture in a signal lacking I pictures may be prolonged during a trick mode. 
As an example, during a fast-forward trick mode, a plurality of pictures are 
skipped to speed up the playback. If P pictures containing the I macroblocks 
are skipped, then it will take longer to properly decode a P picture for 
20 decoding the remaining P and B pictures. As a result, a greater number of 
pictures constructed during the trick mode will suffer from a degradation in 
picture quality. Additionally, the delay in producing an acceptable 
playback increases for a faster playback speed, as a greater number of P 
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pictures may be skipped to accommodate the faster playback. Slow motion 
playback con contribute to a longer delay in producing the properly 
decoded P picture as well. This is because pictures are typically repeated 
during slow motion playback. Since pictures are being repeated, it will take 
longer to obtain a properly decoded P picture since there will be a delay in 
decoding the macroblocks from the five separate P pictures. As a result, the 
acceptable reduction in picture quality during normal playback may 
become unacceptable during trick mode operation. Thus, a need exists for 
a method and system of recording a video segment optimized for trick mode 
playback that overcomes the detriments described above. 
Summary of the Invention 

The invention includes a method of recording onto a storage medium 
a video segment optimized for trick mode playback. The invention includes 
the steps of: receiving the video segment, wherein the video segment 
contains at least one predictive picture; selectively forming at least one 
shadow intra picture from at least one predictive picture; and inserting at 
least one shadow intra picture into the video segment. In one arrangement, 
the video segment can contain a first portion of video and a second portion 
of video, and the second portion of video can contain at least one 
introductory predictive picture. Additionally, the forming step can further 
include the step of selectively decoding a predetermined number of the 
introductory predictive pictures in the second portion of video to obtain a 
properly decoded predictive picture. Also, a portion of each introductory 
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predictive picture can contain intra macroblocks, and tine predetermined 
number can be based in part on the amount of intra macroblocks in each 
introductory predictive picture. 

In another arrangement, the second portion of video can contain at 

5 least one subsequent predictive picture, and the forming step can further 
include the steps of: selectively decoding the subsequent predictive pictures; 
and selectively re-encoding into shadow intra pictures predictive pictures 
selected from the group comprising the subsequent predictive pictures or the 
introductory predictive pictures. In another aspect of the above method, the 

10 inserting step can further include the step of inserting at least one shadow 
intra picture into the first portion of video. Additionally, the invention can 
include the step of ignoring the shadow intra pictures during normal 
playback. In addition, the shadow I picture can be ignored during a 
moderate speed trick mode playback. 

15 The invention can also include a system for recording onto a storage 

medium a video segment optimized for trick mode playback. The system 
can include a receiver for receiving a video segment in which the video 
segment contains at least one predictive picture; and a video processor 
programmed to selectively form at least one shadow intra picture from at 

20 least one predictive picture. In addition, the video processor can be further 
programmed to insert at least one shadow intra picture into the video 
segment. The system also includes suitable software and circuitry to 
implement the methods as described above. 
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Brief Description of the Drawings 

FIG. 1 is a block diagram of a storage medium device tinat can modify 
video by inserting sinadow intra pictures in accordance with the inventive 
arrangements herein. 

FIG. 2 is a flow chart that illustrates the operation of modifying video by 
inserting shadow intra pictures in accordance with the inventive 
arrangements herein. 

Detailed Description of the Preferred Embodiments 

Recordable Storage Medium Device 

A storage medium device 100 for implementing the various advanced 
operating features in accordance with the inventive arrangements is shown 
in block diagram form in FIG. 1 . The invention, however, is not limited to the 
particular device illustrated in FIG. 1 , as the invention can be practiced with 
any other storage medium device capable of receiving a digitally encoded 
signal. In addition, the device 100 is not limited to reading data from or 
writing data to any particular type of storage medium, as any storage 
medium capable of storing digitally encoded data can be used with the 
device 100. 

The device 100 can comprise an input processing path 140 and an 
output processing path 170. Further the device 100 can include a controller 
1 10 for reading data from and writing data to a storage medium 112. The 
device 100 can also have a control central processing unit (CPU) 122. 
Control and data interfaces can also be provided for permitting the control 
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CPU 122 to control the operation of a packet video encoder 144, a paclcet 
video decoder 178, an audio decoder 182, a searching engine 174 and the 
controller 1 10. Suitable software or firnnware can be provided in nnennory for 
the conventional operations performed by control CPU 122. Further, program 
routines for the editing recorded video features 134 are provided for 
controlling CPU 122 in accordance with the inventive arrangements. 

A control buffer 132 for viewer activatable functions can indicate those 
functions presently available, namely play, record, reverse, fast forward, slow 
play, jump, pause/play and stop. In addition, advanced features, depicted 
by block 136, can be provided to receive commands for implementing 
recorded video editing features. 

The output processing path 1 70 can include a track buffer 1 72, the pre- 
processing engine 174, a demultiplexer 176, the packet video decoder 178, a 
TV encoder 180, the audio decoder 182 and an audio D/A 184. The track 
buffer 1 72 can read and temporarily store for further processing data read 
from the storage medium 112. The data can be sent to the demultiplexer 176 
where it can be divided into respective paths for video and audio 
processing. The searching engine 1 74 can process data read from the 
storage medium 112 by locating pictures in the data read from the medium 
112. The pre-processing engine 174 can locate pictures in the data by 
locating each picture's start code. Once a start code is located, the 
searching engine 174 con signal the control CPU 122. The control CPU 122 
can then determine whether the picture is an I, B or P picture by focusing on 



that particular picture's start code. In this arrangement, the control CPU 122 
can then signal the packet video decoder 1 78 to refrain fronn decoding a 
particular picture thus preventing that picture fronn being displayed. It should 
be understood that all or portions of the control CPU 122, the searching 

5 engine 174, the decoder 178 and the encoder 144 can be considered a 
video processor 1 90 within contemplation of the present invention. 

In accordance with the inventive arrangements, one or more shadow I 
pictures can be inserted into a digitally encoded video signal. A shadow I 
picture is an I picture that can be used to construct other pictures in a 

10 recorded video signal during severe trick mode playback but can be 
ignored during normal or moderate speed trick mode playback. In one 
arrangement, the shadow I pictures can be inserted into a digitally encoded 
signal that does not contain any I pictures; however, the invention is not so 
limited, as shadow I pictures can be inserted into video signals that have 

15 conventional I pictures. As will be explained below, one or more pictures in 
such a signal can be re-encoded into a shadow I picture. In this 
arrangement, a video segment into which shadow I pictures are to be 
inserted can be received by a receiver or buffer 149. The video segment can 
be comprised of a first portion of video and a second portion of video in 

20 which the first portion of video can receive the shadow I pictures, and the 
second portion of video can be used to create the shadow I pictures. In one 
arrangement, the second portion of video can contain one or more pictures 
from the first video signal. 
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The second portion of video con be received by tine poclcet video 
decoder 1 78. One or more of the pictures in the second portion of video can 
be selectively decoded by the decoder 1 78 to create a properly decoded 
picture, which can then be used to decode selectively the other pictures in 
5 the second video signal. The second video signal can then be sent to the 
packet video encoder 144. The pictures in the second portion of video that 
were selectively decoded by the decoder 1 78 can be used by the encoder 
144 to create one or more shadow I pictures by selectively re-encoding such 
pictures into shadow I pictures. 
10 Once the shadow I pictures are formed, the remaining pictures that 

were not re-encoded into shadow I pictures can be discarded. The shadow I 
pictures in the second portion of video can then be combined with the first 
portion of video in a multiplexer (MUX) 150 thereby modifying the original 
video segment. The modified video segment can then be stored in a record 
15 buffer 152 until it can be recorded onto the storage medium 1 12. Thus, the 
video segment can be modified by adding to it one or more shadow I 
pictures. This process will be explained in greater detail below. 

Notably, the present invention can be realized in hardware, software, 
or a combination of hardware and software. Machine readable storage 
20 according to the present invention can be realized in a centralized fashion in 
one computer system, for example the control CPU 122, or in a distributed 
fashion where different elements are spread across several interconnected 



computer systems. Any kind of computer system or other apparatus 
adopted for carrying out the methods described herein is acceptable. 

Specifically, although the present invention as described herein 
contemplates the control CPU 122 of FIG. 1, a typical combination of 
5 hardware and software could be a general purpose computer system with a 
computer program that, when being loaded and executed, controls the 
computer system and a DVD recording system similar to the control section 
120 of FIG. 1 such that it carries out the methods described herein. The 

J present invention can also be embedded in a computer program product 

which comprises all the features enabling the implementation of the methods 

9} described herein, and which when loaded in a computer system is able to 
carry out these methods. 

Ns A computer program in the present context con mean any expression, 

O in any language, code or notation, of a set of instructions intended to cause 
15 a system having an information processing capability to perform a particular 
function either directly or after either or both of the following: (a) conversion 
to another language, code or notation; and (b) reproduction in a different 
material form. The invention disclosed herein can be a method embedded 
in a computer program which can be implemented by a programmer using 
20 commercially available development tools for operating systems compatible 
with the control CPU 122 described above. 
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MODIFYING VIDEO BY INSERTING SHADOW INTRA PICTURES 

According to the inventive arrangements, the poor picture quality 
associated with tricic mode playback of recorded video not having I pictures 
5 can be improved by forming one or more shadow i pictures from one or 
more P pictures contained in the original video signal. These shadow I 
pictures can then be inserted into the video signal as the video signal is 
recorded and can be used to reconstruct the non-intra pictures contained in 
t: the video during a severe trick mode playback of the recorded video. 
£.10 Notably, however, these shadow I pictures con be ignored during normal 
0] playback, or a less severe trick mode playback, so as not to interfere with the 
% original broadcast structure. 

FIG. 2 illustrates a flowchart 200 that demonstrates one way in which 
O video containing P pictures with I macroblocks - typically, a signal with no I 
15 pictures - can be modified for optimal trick mode performance. At step 210, 
a video signal containing at least one P picture can be received. As noted 
earlier, many video broadcast signals, particularly U.S. cable transmissions, do 
not contain i pictures. Many of these signals are made up of a number of 
video sequences containing a predetermined number of non-1 pictures. The 
20 following is an example of a typical video sequence contained in such a 
signal: 

SH Bo Bi P2 Bs B4 Ps B6 B/ Ps B9 Bio Pii B12 B13 Pi4 
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As shown, the example contains only non-intra pictures (P and B 
pictures) and does not contain any I pictures. A portion of each P picture is 
typically encoded with I macroblocks. During normal playback, the pictures 
in the sequence can be constructed from the macroblocks, both I and non-1 

5 macroblocks, in the P pictures. Experience has shown that encoding 
approximately twenty percent of each P picture with I macroblocks and 
placing two B pictures between P pictures works well. Accordingly, the 
typical sequence as shown above is commonly used and will be used to help 
explain the invention. Those skilled in the art, however, will appreciate that 

10 other video sequences lacking I pictures are also commonly used and may 
be considered typical. In fact, any video sequence that contains at least 
one P picture can be modified in accordance with the inventive 
arrangements; this includes video signals that contain I pictures. 

The pictures in the typical video sequence shown above can represent 

15 progressive frames, non-progressive frames or field pictures, as the invention is 
not limited to any particular picture format. The symbol "SH" stands for 
sequence header, which is a header that contains decoding information 
about the particular video sequence to which it is assigned, it should be 
noted, however, that the invention is not limited to such an arrangement, as 

20 the invention con be practiced with video sequences that do not hove 
sequence headers. 
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At step 212, the received video signal can be temporarily stored as a 
first portion of video. The following represents an exannple of a first portion of 
video which contains two typical video sequences: 

SHi Bo Bi P2 B3 B4 P5 B6 B7 Ps B9 Bio Pn B12 B13 Pu 
SH2 Bi5 B16 Pi7 B18 Bi9 P20 B21 B22 P23 B24 B25 P26 B27 B28 P29 
It should be noted that this is merely an example of a first portion of video, as 
such a portion can contain any amount of video and is not limited to these 
particular types of video sequences. A second portion of video containing 
one or more of the pictures from the first portion of video can be selectively 
decoded to obtain a properly decoded picture, as shown in step 214. In one 
arrangement, the second portion of video can contain all the non-1 pictures 
from the first portion of video or, alternatively, all the P pictures. In either 
arrangement, one or more of the P pictures in the second portion of video 
can be decoded until a properly decoded P picture is obtained. For 
purposes of explaining the invention, however, in this example, the second 
portion of video will contain all the pictures shown in the two typical video 
sequences from the first portion of video. 

In one embodiment, the number of the P pictures in the second portion 
of video to be decoded can depend on the amount of I macroblocks in the 
P pictures. As an example, the five P pictures in the first video sequence 
reproduced above - P2, Ps, Ps, Pii and Pu - can be decoded, which can 
result in picture Pi 4 being properly decoded. As discussed earlier, five P 
pictures can be used to properly decode a P picture because generally a 
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separate portion (approximately twenty percent) of eacli P picture in tine 
typical video sequence is comprised of I macroblocks. It should be noted, 
however, that the invention is not limited to the preceding example, as any 
other suitable number of P pictures can be decoded for purposes of 
5 obtaining a properly decoded P picture. For instance, these initial P pictures 
can contain different percentages of I macroblocks. For purposes of clarity, 
the P pictures used to obtain the properly decoded P picture can be referred 
_ to as introductory P pictures. 

J Once a properly decoded P picture is obtained from decoding the 

po introductory P pictures in the second portion of video, the properly decoded 
P picture can be used to decode selectively one or more subsequent P 

'f~, pictures in the second portion of video, as shown in step 21 6. For example, 
continuing with the video sequences shown above, once picture Pi 4 is 

p properly decoded, the P pictures in the next video sequence - P17, P20, P23, P26 
15 and P29 - can be properly decoded as well. In one arrangement, it is 

preferable that all the subsequent P pictures in the second portion of video 
be decoded; however, the invention is not limited in this regard, as any other 
suitable number of subsequent P pictures can be decoded. 

In another arrangement, if one or more P pictures are skipped once a 
20 properly decoded P pictures is acquired, i.e., less than all the P pictures in the 
second portion of video are decoded, one or more P pictures following the 
skipped P picture{s) can be used to create another properly decoded P 
picture for purposes of decoding the subsequent P pictures. The P pictures 
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following the skipped P picture that are used to construct another properly 
decoded P picture con be referred to as introductory P pictures as well. 

At step 218, once the desired number of subsequent P pictures are 
decoded, one or nnore of the selectively decoded subsequent P pictures can 
5 be re-encoded into a shadow 1 picture. In addition, one or more of the 
introductory P pictures can be re-encoded into a shadow I picture. The 
following is an example of such a process: 

SHi Bo Bi h Bs B4 Ps B6 B7 Ps B9 Bio Pn B12 Bis Ph 
SH2 Bi5 B16 Ii7 Bi8 Bi9 P20 B21 B22 P23 B24 B25 P26 B27 B28 P29 
10 As shown, pictures P2 and Pi 7 have been re-encoded into shadow I pictures I2 
and Ii7 respectively. It should be noted that the invention is not limited to this 
particular example or any particular re-encoding algorithm, as any number 
of introductory or subsequent P pictures can be re-encoded into a shadow I 
picture. 

15 For example, pictures Ps and P20 from the above video sequences, in 
addition to pictures P2 and Pi 7, could also be re-encoded into shadow I 
pictures. 

In one arrangement, during the re-encoding step, the number of bits 
contained in the shadow I pictures can be reduced. Lowering the number of 
20 bits contained in the shadow I pictures can reduce the picture quality; 

however, this reduction in picture quality is acceptable for purposes of trick 
mode playback, and shadow I pictures containing a reduced number of bits 
require less storage space and/or bandwidth. 
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After the shadow I pictures have been formed, the remaining pictures 
in the second portion of video - the pictures that were not selectively re- 
encoded into shadow I pictures - can be discarded, as shown in step 220. 
Thus, in the above example, the only pictures that would remain after step 
5 220 would be b and h/. At step 222, the shadow I pictures in the second 
portion of video can be inserted into the first portion of video. The shadow I 
pictures can be inserted in any suitable location in the first portion of video 
and at any suitable frequency. In one arrangement, the second portion of 
:p video can contain all the pictures from the first portion of video. In that case, 
#10 the video sequences in the second portion of video correspond to the video 
t- sequences in the first portion of video. If a shadow I picture is created from 
p each video sequence in the second portion of video, then each shadow I 
?fl picture can be inserted into its corresponding video sequence in the first 
J=f portion of video. The following shows an example of adding the shadow I 
15 pictures from the second portion of video to their corresponding video 
sequences contained in the first portion of video: 

SHi Bo Bi P2 h Bs B4 Ps B6 Bz Ps B9 Bio Pn B12 B13 Pm 
SH2 Bi5 B16 Pi7 Ii7 B18 Bi9 P20 B21 B22 P23 B24 B25 P26 B27 B28 P29 
As shown, pictures I2 and hz from the video sequences in the second 
20 portion of video have been inserted into their corresponding video 

sequences contained in the first portion of video. Although the pictures I2 
and Ii7 were inserted next to pictures P2 and P17 respectively, it should be 
noted that the invention is not limited to this particular example. In fact. 
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each shadow I picture can be inserted anywhere in its corresponding video 
sequence or any other video sequence in the first video segnnent. 

The modified first video segment con then be recorded onto a storage 
medium, as shown at step 224. Although it is desirable to store the shadow I 

5 pictures on the storage medium in the same location as the modified video 
segment, the shadow I pictures can be stored at any suitable location on the 
storage medium. 

This modification can permit the first video segment - the original 
incoming video - to have shadow I pictures inserted into it from which the 

10 non-intra pictures can be constructed during trick mode playback. As such, 
this process of adding shadow I pictures improves the picture quality during a 
trick mode, as the pictures in the modified video segment no longer depend 
on a plurality of P pictures to be decoded. 

Once recorded onto the storage medium, the modified first video 

15 segment con be played back. If playback is initiated at step 226, then a 
determination is made at step 228 as to whether the playback is a trick 
mode. If the playback is a trick mode, then the shadow I pictures in the 
modified video segment can be used to construct the other pictures in the 
modified segment, as shown in step 230. If the playback is a normal 

20 playback, then the shadow I pictures con be ignored, as shown in steps 232 
through 238. 

In another arrangement, if the speed of a fast-motion trick mode 
playback does not excessively deviate from the speed of normal playback. 



PU010150 

as may be decided at decision block 229, tinen only the B pictures in the 
signal read from the storage medium need to be skipped during the trick 
mode, and the I macroblock encoded P pictures in the signal can be used to 
construct the pictures in the signal, and the process can continue as 

5 previously explained with respect to steps 232 - 238. Similar to normal 
playback, the shadow I pictures can be ignored during less severe, fast- 
motion trick mode speeds. As an example, referring once again to the 
typical video sequences discussed above, up to ten B pictures could be 
skipped in one video sequence before the P pictures would have to be 

10 skipped during a fast-forward or fast-reverse trick mode playback. Removing 
ten B pictures from this sequence would produce a playback three times as 
fast as normal playback and would still allow the shadow I pictures to be 
ignored. If a fast motion trick mode playback speed does excessively 
deviate from normal playback speed at decision block 229, then shadow I 

15 pictures should be used to decode the other pictures, as shown in step 230. 
Moreover, for a less severe slow motion playback, the P pictures, 
instead of the shadow I pictures, can be used to decode the other pictures in 
the video signal read from the storage medium, as a relatively faster slow 
motion speed will not produce a significant decoding delay. For example, if 

20 twenty percent of each P picture contains I macroblocks and a reference 
picture can be created within approximately one-half second, then a slow 
motion playback of one-half the normal playback speed will increase the 
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decoding delay to approximately one second. As sucli, ihe sinadow I 
pictures can also be ignored during a relatively faster slow motion playback. 

At step 232, during normal playback, or, alternatively, a less severe trick 
mode playback, a search can be conducted to locate the pictures 

5 contained in the modified first video segment. In one arrangement, the pre- 
processing engine 174 and the control CPU 122 of FIG. 1 can be used to 
locate the pictures. At step 234, if the control CPU 122 determines that a 
picture is a shadow I picture, then the shadow I picture will not be decoded 
and, as a result, will not be displayed during normal playback, as shown in 

0 step 236. If, however, the picture is not a shadow I picture, then such picture 
can be decoded and displayed in accordance with step 238. 

Although the present invention has been described in conjunction with 
the embodiments disclosed herein, it should be understood that the foregoing 
description is intended to illustrate and not limit the scope of the invention as 

5 defined by the claims. 



